Papers by Raj Sanjay Shah
Responsible Evaluation of AI for Mental Health (2026.acl-long)
Copied to clipboard
Hiba Arnaout, Anmol Goel, H. Andrew Schwartz, Steffen T. Eberhardt, Dana Atzil-Slonim, Gavin Doherty, Brian Schwartz, Wolfgang Lutz, Tim Althoff, Munmun De Choudhury, Hamidreza Jamalabadi, Raj Sanjay Shah, Flor Miriam Plaza-del-Arco, Dirk Hovy, Maria Liakata, Iryna Gurevych
| Challenge: | Existing approaches to evaluating AI tools in this domain remain fragmented and inconsistent. |
| Approach: | They propose a taxonomy of AI mental health support types that integrates clinical soundness, social context, and equity to provide a structured basis for evaluation. |
| Outcome: | The proposed framework integrates clinical soundness, social context, and equity, providing a structured basis for evaluation. |
From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are rapidly growing and allowing textual content to be protected against unauthorized use. |
| Approach: | They present a unified overview of different perspectives behind designing watermarking techniques through a comprehensive survey of the research literature. |
| Outcome: | The proposed methods are based on the evaluation datasets used and watermarking addition and removal methods to construct a taxonomy. |
TN-Eval: Rubric and Evaluation Protocols for Measuring the Quality of Behavioral Therapy Notes (2025.acl-industry)
Copied to clipboard
| Challenge: | Behavioral therapy notes are important for legal compliance and patient care, but quality standards for them remain underdeveloped. |
| Approach: | They propose a rubric for evaluating therapy notes across key dimensions: completeness, conciseness, faithfulness. |
| Outcome: | The proposed evaluation framework improves on therapist-written notes and LLM-generated notes. |